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Image Interpolation and Decimation Using a Continuously Variable Delay Filter and 
Combined with a Polyphase Filter 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to the field of digital signal processing, and in particular 
to a digital filter for interpolating and decimating digitally encoded images. 

5 

2. Description of Related Art 

In a digital display system, sample rate converters (SRCs) are used to effect a 
scaling of a digitally encoded image. A digitally encoded image, such as a video image, 
comprises an array of samples of the original image, A display screen area comprises an 

1 0 array of pixels, which may or may not correspond to the array of samples of the original 
image. If the number of samples in the horizontal and vertical direction are equal to the 
number of pixels in the horizontal and vertical direction, no scaling is necessary. Each sample 
is mapped to each corresponding pixel, and the resultant displayed image corresponds to the 
original image. If there are half the number of pixels as there are samples, every other sample 

1 5 is mapped to a corresponding pixel. The resultant image corresponds to an image that is 
sampled at half the sampling rate of the original samples. That is, a change of scale is 
equivalent to a change of sampling rate, hence the term 'sample rate converter'. Non-integer 
scaling is effected by generating pixel values corresponding to an estimate of the sample 
value that would have been obtained had the original sampling rate corresponded to this 

20 display scale. If the image is being down-sized, or down-converted, a decimator is used to 
"remove" sample values; if the image is being up-sized, or up-converted, an interpolator is 
used to "add" sample values. Conventional display systems include both a vertical sample 
rate converter and a horizontal sample rate converter to effect the scaling in either or both 
dimensions. If the display system is configured to only provide down-scaled images, such as 

25 a "picture-in-picture" feature, the sample rate converters comprise only a decimator. If the 
display system is configured to only present up-scaled images, such as a "zoom" feature, the 
sample rate converters comprise only an interpolator. To provide both up-scaling and down- 
scaling, the sample rate converters of conventional high-quality display systems include both 
a decimator and an interpolator. 



WO 01/52546 PCT7EF00/12922 

2 

Decimators and interpolators are typically embodied as digital filters, wherein 
the resultant pixel value is a weighted average of the samples in the vicinity of the pixel 
location. The number of samples used to determine the resultant weighted average is termed 
the number of "taps" of the digital filter. The general equation for an N-tap filter is given by: 

yO+p)=T J c(.n,p)*x(i-n). (1) 

where x(i). ..x(i-(N-l)) are the input samples at each tap of the N-tap filter, p is the phase, and 
c(n,p) is the weight associated with each input sample at the specified phase. To provide a 
variety of scale factors, a "polyphase" filter is used. Each phase of a P-polyphase filter 
corresponds to an integer multiple of 1/P of the output scale for down-sampling, or If? of the 
input scale for up-sampling. 

FIG. 1 illustrates a conceptual block diagram of an up-sampling polyphase 
filter with P phase stages 1 10a- 1 lOp. Input samples 101 are provided to each stage. If the 
output is an up-scaling by a factor of 1 :P, the output of each stage 1 lOa-p is selected by the 
switch 120, and P output values are provided in response to the receipt of each input sample 
101. After producing the P output values, the next input sample 101 is received, and another 
P outputs are provided. In this manner, P output values are formed for each input sample, 
thereby providing an up-scaling by a factor of 1 :P. If an up-scaling of Q:P is desired, Q of the 
P stages are selected for output for each input sample. For example, if Q is three, every third 
stage 101a, lOld, etc. is selected for output for each input sample. 

FIG. 2 illustrates a conceptual block diagram of a down-sampling polyphase 
filter with P phase stages 210a-210p. The input samples 201 are provided to select stages via 
the switch 220. If the output is a downscaling by a factor of P:l, the output of all P stages 
21 Oa-p are combined by the adder 230, and a single output value 23 1 is provided in response 
to the receipt of P input samples 201 . After producing the output value, another set of P 
inputs 201 are used to produce the next output sample 231 . In this manner, one output value 
is formed for P input samples, thereby providing a downscaling by a factor of P:l. If a 
downscaling of Q: 1 is desired, Q input samples 201 are provided to select input stages 21 Oa-p 
and the output of these stages are combined by the adder 230 to produce the single output 
sample 23 1 . 

A polyphase filter with N taps is typically embodied as a single filter with N 
registers and a memory that is configured to store the N coefficients for each of the P stages. 
The appropriate N coefficients are loaded into the N registers of the filter to produce each 
required output. US patent 5,892,695, SAMPLE RATE CONVERTER, issued 6 April 1999 
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for Age J. Van Dalfsen, Jeroen H. J. C. Stessen, and Johannes G. W. M. Janssen, discloses a 
polyphase filter configuration for effecting up-scaling and down-scaling, and is incorporated 
by reference herein. FIG. 3 illustrates an up-scaling polyphase filter as taught in the 
referenced patent, and FIG. 4 illustrates a down-scaling polyphase filter as also taught in the 

5 referenced patent. 

In FIG. 3, each input sample x(i) 101 is sequentially clocked into the first 
polyphase delay elements 310. For each output sample y 121, the appropriate coefficient 
c(n,p(q)) is applied to the multipliers 320, where p(q) is the phase delay corresponding to the 
particular phase of the polyphase filter for each output sample y 121 . After each of the 

10 upscaled samples y 121 are produced, the next input sample x(i) 101 is clocked into the first 
polyphase delay element 3 1 0, while the prior x(i) sample is clocked on to the next delay 
element 31 1, and the above process is repeated. 

In FIG. 4, each input sample x(i) 201 is multiplied by the appropriate 
coefficient c(n,p(q)), and an intermediate sum is accumulated in the corresponding delay 

1 5 element 4 1 0, 4 1 1 , etc. by setting the switches 440 to effect a loop of the contents of the delay 
element through the adder 430. When the input x(i) 201 arrives in a Q:l downscaling, the 
switch 440 is set to effect a transfer of the contents of each delay elements on to the next 
delay element, also via the adder 430 that adds the appropriate c(n,p(q))*x(i) to the 
accumulated sum that is transferred to the next delay element. The referenced patent contains 

20 additional detail regarding the operation of the filters of FIGs. 3 and 4. 

The coefficients c(n,p) for each of the P phases of a polyphase filter are 
typically stored in a local memory, for application to the multipliers 320, 420 as required. 
The storage requirement for a P-polyphase filter with N-taps is P*N, and is illustrated by an 
array 510 of coefficients c(n,p) in FIG. 5. Each of the P rows of FIG. 5 contains the N- 

25 coefficients for a given phase p, each of the N columns corresponding to each of the 
coefficients for a given tap. 

U.S . patent 4,866,647, "CONTINUOUSLY VARIABLE DIGITAL DELAY 
CIRCUIT", issued 12 September 1989 to C. W. Farrow, incorporated by reference herein, 
describes a filter, hereinafter a "Farrow filter", wherein the individual coefficient of each tap 

30 is computed based on a polynomial equation. Each column of coefficients 520 is 

approximated by an L-order polynomial 530 having phase p as the independent variable, and 
the coefficient c(n,p) 520 at this phase as the dependent variable, using conventional curve 
fitting techniques. By using a polynomial approximation, the coefficients c(n,p) of any phase 
value p can be computed, and therefore the Farrow filter provides a continuous phase filter. A 
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continuous phase filter is conventionally termed a continuous delay filter. As contrast to the 
polyphase filter, which has a resolution of 1/P (interpolations beyond 1 :P are limited to, at 
most, P unique values, any additional values being either duplicates or combinations of these 
P unique values), the resolution of a continuous phase filter is virtually unlimited (each phase 
generates a unique set of coefficients, subject only to the precision of the coefficient 
generator). The accuracy of the Farrow filter, compared to a polyphase filter, depends 
primarily upon the order of the polynomial approximation. It has been found that a third- 
order polynomial provides acceptable accuracy, a fourth-order polynomial being common in 
high quality Farrow filters. The resolution of the Fairow-filter is dependent only upon the 
resolution of the curve-fitting coefficients b(n,l) and the resolution of the input parameter 
corresponding to the phase p being estimated, hereinafter termed the delay parameter d. 
Preferably, the curve fitting coefficients are determined such that a range of d from 0 to 2" 
1 corresponds to a range of phase from 0 to 2n, where m is the number of bits used to contain 
the delay term d. 

FIG. 6A illustrates a block diagram of a direct embodiment of an up-scaling 
Farrow filter. Each oftheN blocks 610, 611, ... 615 are configured to compute the 
coefficients c(0), c(l), . . . c(n) for use by the filter 320 to produce the output y 121 
corresponding to an input x(i) 101 and phase d 602. The filter 320 corresponds to a 
conventional filter, such as used in the aforementioned polyphase filter 100, as described by 
equation 1, repeated here for ease of reference: 

y(i+p)= J Lc(n,p)*x(i-n). 0) 

The operation of the Farrow filter can be defined as: 

y(i+p)= l[ibMp')xQ-n), (2a) 

where b(n,l) are the coefficients of the L degree polynomial for computing each of the 
coefficients c(n,p) of the N taps. As can be seen, the Farrow filter requires, the storage of the 
b(n,l) coefficients (N*(L+1) storage locations), rather than the storage of the c(n,p) 
coefficients (N*P storage locations). Typically, the order of the polynomial, L, is less than 5, 
whereas a common polyphase filter has 32 or more discrete phases. Therefore, a Farrow filter 
with L-order polynomials saves (P-(L+1))*N storage locations compared to a polyphase filter 
with P stages. 

Although a Farrow filter requires fewer storage locations, it requires substantially more 
operations per output sample, requiring at least N*(L+1)+L-1 multiplications for each output 



WO 01/52546 PCT/EPO0/12922 

5 

sample (L-l multiplications to form the powers of p, plus L coefficient multiplications per 
tap, plus N multiplications in the filter 320), compared to a mere N multiplications per output 
sample in a polyphase filter. 

To reduce the complexity of a Farrow filter, the following transformation of 
terms is conventionally used: 

y0'+ P) = t [ZKnMi-nMp 1 (2b) 

/-OVn-0 ' 

The embodiment of equation 2b is illustrated in FIG. 6B, wherein each of the blocks 660, 
661, ... 665 are configured to generate the inner summation of equation 2b. Each of the 
blocks 660-665 can be embodied using the structure of FIG. 3, wherein the c(n,d) terms are 
replaced by the corresponding b(n,l) terms (1=0 in block 660, 1=1 in block 661, etc.). Note 
that the inner summation need only be computed once per input sample, each of the 
subsequent outputs at different phases being computed by the multipliers 330 and adders 340 
as each phase p is input. This embodiment requires N*(L+1) multiplications for each input, 
and L multiplications for each output, a substantial reduction compared to the N*(L+1)+L-1 
multiplications for each output of the direct embodiment of the Farrow filter. Note, however, 
that this optimization is limited to interpolation, wherein multiple outputs are generated for 
each input. 

Farrow filters are not currently used in conventional video systems, due 
primarily to their computational complexity compared to a polyphase filter. As is known in 
the art, hardware multipliers are costly in terms of circuit area, and high-speed multipliers are 
costly in terms of power. Software filters can take advantage of general purpose high-speed 
multiplier co-processors, but the transfer of information for each multiplication is often too 
costly in time. This problem is particular acute for decimation, where the interpolation- 
optimized embodiment of FIG. 6B is not available. 

BRIEF SUMMARY OF THE INVENTION 

It is an object of this invention to improve the scaling capabilities of an image 
display system. It is a further object of this invention to provide a selectable scaling 
resolution capability. It is a further object of this invention to provide a filter that can be 
configured to provide both decimation and interpolation capabilities. 

These objects and others are provided by a variety of aspects of this invention. 

In a first embodiment, a filter structure is provided that facilitates the use of 
the filter as either a continuous delay Farrow filter or a selectable delay polyphase filter. The 
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less complex polyphase filter is used when the desired scale substantially corresponds to a 
defined phase of the polyphase filter, or when time or power is not available to achieve the 
desired scale exactly; otherwise, the continuous delay Farrow filter is used. By providing an 
ability to switch to a continuous delay, the number of stages of the polyphase filter can be 
5 reduced. 

In another embodiment, an inversion of a Farrow filter is presented that 
provides for a continuous delay decimation filter with substantially reduced computational 
complexity compared to a direct embodiment of a Farrow filter. This inverted filter is also 
configurable as a polyphase filter, to provide selectable scale-resolution capabilities. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is explained in further detail, and by way of example, with 
reference to the accompanying drawings wherein: 

FIG. 1 illustrates an example conceptual diagram of an up-scaling polyphase filter, common 
15 in the art. 

FIG. 2 illustrates an example conceptual diagram of an down-scaling polyphase filter, 
common in the art. 

FIG. 3 illustrates an example block diagram of an up-scaling polyphase filter, common in the 
art. 

20 FIG. 4 illustrates an example block diagram of an down-scaling polyphase filter, common in 
the art. 

FIG. 5 illustrates an example array of coefficients corresponding to a polyphase filter, 
common in the art. 

FIGs. 6A-6B illustrate an example block diagram of a prior art Farrow filter for up-scaling. 
25 FIGs. 7A-7B illustrate an example block diagram of a combination polyphase and Farrow 
filter for up-scaling in accordance with this invention. 

FIG. 8 illustrates an example block diagram of a Farrow filter that is optimized for down- 
scaling in accordance with this invention. 

FIG. 9 illustrates an example block diagram of a combination polyphase and Farrow filter for 
30 down-scaling in accordance with this invention. 

FIG. 10 illustrates an example block diagram of a combination interpolation and decimation 
filter stage for use in an up-scaling and down-scaling Farrow filter in accordance with this 
invention. 
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FIG. 1 1 illustrates an example block diagram of a display system in accordance with this 
invention. 

Throughout the drawings, the same reference numerals indicate similar or 
corresponding features or functions. 

5 

DETAILED DESCRIPTION OF THE INVENTION 

FIG. 7A illustrates an example block diagram of a combination polyphase and 
Farrow filter 700 for up-scaling in accordance with this invention. The combination filter 700 
allows the use of the filter as either a continuous delay Farrow filter or a selectable delay 

1 0 polyphase filter, depending upon the state S of the switch 7 1 0 and the coefficients K(n,m) 
that are applied within the filter segment 760. In accordance with this invention, the 
coefficients K(n,m) are either the polyphase coefficients c(n,p), or the Farrow-filter 
coefficients b(n,0), depending upon whether discrete-delay polyphase filtering or continuous- 
delay Farrow-filtering is to be performed. 

15 If the state of the switch 710 is open, the coefficients K(n,m) that are applied 

within the filter segment 760 are the conventional selectable delay polyphase filter 
coefficients c(n,m), where m corresponds to each of the phases corresponding to each output 
sample 121. In this way, the combination filter 700 performs as a conventional selectable 
delay up-scaling polyphase filter, as discussed above with regard to FIGs. 1 and 3. 

20 If the state of the switch 710 is closed, the coefficients K(n,m) that are applied 

within the filter segment 760 are the conventional continuous delay Farrow filter coefficients 
b(n,0), corresponding to the constant terms of the polynomial approximations of each of the n 
taps. The input x(i) 101 is applied to each of the other filter elements 661-665, via the closed 
switch 710, and the outputs of each other filter element 661-665 are combined via the 

25 multipliers 630 and adders 640. In this way, the combination filter 700 performs as a 

conventional continuous delay up-scaling Farrow filter, as discussed above with regard to 
FIGs. 6A and 6B. 

As illustrated, the combination polyphase and Farrow filter 700 of this 
invention selectively operates as either a polyphase filter or a Farrow filter for up-sampling, 
30 or interpolation, of input samples x(i) 101. This selectivity allows the use of the polyphase 
filter mode when the desired degree of up-scaling corresponds substantially to one of the 
discrete interpolation factors provided by the stored polyphase filter coefficients. That is for 
example, if P sets of polyphase filter coefficients are provided, interpolation factors of Q:P 
can be achieved directly, where Q and P are integers, by using the coefficients of every "Q*" 
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phase for each output sample. Conversely, when the desired up-sampling ratio does not 
correspond to an interpolation factor of Q:P, where Q and P are integers, the combination 
filter 700 can be switched into the Farrow-filter mode. In the Farrow-filter mode, the required 
interpolation factor is achieved by providing the phase-shift, or delay, d 602, associated with 
5 each output sample y 1 2 1 . In this manner, the resolution of the achievable up-sampling ratio 
is only dependent upon the resolution of the delay d 602, as discussed above with respect to 
FIG. 5. 

The selection between the use of a polyphase-filter or a Farrow-filter can 
provide a number of advantages. The power consumed by a device, and particularly a CMOS 

10 device, is highly dependent upon the number of operations preformed by the device, and thus 
the power consumed by the selection of the polyphase-filter in lieu of the Farrow-filter is 
substantially lower. In addition to the generally preferable use of less power whenever 
possible, specific application advantages can be realized. A portable computer, for example, 
can be configured to use only interpolation factors that are supported by the polyphase-filter 

1 5 when the computer is being powered by battery, and to use the Farrow-filter selection as 
required only when power is being supplied from an external source. Similarly, a display 
device may be configured to only contain the filter segment 760 of FIG. 7A as a "default" 
configuration, and the other segments 661-665 and associated multipliers 630 and adders 640 
may be packaged as a video-enhancement module that can be purchased at an additional cost. 

20 The default configuration will provide, for example, discrete zooming capabilities, whereas 
the enhanced version will provide substantially continuous zooming capabilities. These 
advantages, and others, will be evident to one of ordinary skill in the art in view of this 
disclosure. 

FIG. 7B illustrates an example embodiment of the combination filter 700, 
25 using the structure of the referenced US patent 5,892,695 for each filter segment 661-665 and 
760 of FIG. 7 A. For ease of understanding, an example M:l up-scaling is presented to 
describe the operation of the filter 700 in each filter mode. In the Farrow-filter mode, as each 
input signal x(i) is clocked into each filter segment, the M output samples y(i+d) 121 
corresponding to each input signal are produced by providing each delay d 602 associated 
30 with each output sample y(i+d) 121 to the multipliers 630, and propagating the sums via the 
adders 640 to the output 121 . The M delays d 602 correspond to phases spaced at 2tc/M 
intervals for each input sample x(i) 101. In the polyphase mode, as each input sample signal 
x(i) is clocked into each filter segment, the M output samples y(i+d) 121 are produced by 
providing the polyphase coefficients c(n,d) corresponding to each phase delay d (at 2?t/M 
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intervals) associated with each output sample y(i+d) 121. This assumes that the polyphase 
filter coefficients c(n,d) are available for each phase delay d. After providing the M output 
samples 121, the next input sample x(i) 101 is clocked into filter segment 760, and, if in 
Farrow-filter mode, into filter segments 661-665, and the above processes are repeated. 

5 If the interpolation factor is a non-integer F, the process is performed as 

described above, with each delay being evenly spaced by 2rc/F, except that some spans 
between input samples will contain one more or one less samples than the other spans. For 
example, if the upscale factor is 3.6, the phase interval between output samples will be 100 
degrees (360°/3.6). Assuming that the initial phase is 10 degrees, the first interval between 

1 0 input samples will contain 4 samples (at 10°, 11 0°, 2 1 0°, and 3 1 0° degrees), the next interval 
will contain 4 samples ((410°, 510°, 610°, 710°), or, (50°, 150°, 250°, 350°) relative to the 
next input sample), but the next interval will contain only 3 samples ((8 1 0°, 9 1 0°, 1 0 1 0°), or, 
(90°, 190°, 290°)), because the sample at 1 1 10° is within the span of the next input sample. 
Within every five intervals between input samples, three intervals will contain 4 output 

1 5 samples, and two intervals will contain 3 output samples, for a total of 1 8 output samples per 
5 input samples, corresponding to an interpolation ratio of 3.6:1. In this example, if the 
polyphase coefficients c(n,p) correspond to 36 phases (every 10 degrees), the up-scaling can 
be performed by placing the combination filter 700 in the polyphase-mode, via switch 710, 
and each of the output samples can be produced by the filter segment 760 only. If, on the 

20 other hand, the polyphase coefficients c(n,p) correspond to 60 phases (every 6 degrees), the 
3.6:1 scaling cannot be accurately accomplished using these polyphase filter coefficients. In 
this example, the combination filter 700 is set to the Farrow-filter mode, via the switch 710, 
and the appropriate delays are provided as input d 602 to the combination filter 700, 
corresponding to the 10°, 1 10°, 210°, 3 10°, 50°, 150°, 250°, 350°, 90°, 190°, 290°, etc. 

25 sequence of phase angles presented above. Preferably, the sequencing of the filter 700 is 

effected by repeatedly providing the delay interval to an accumulator that is structured to 'roll 
over' and generate a carry whenever the accumulated phase exceeds 2rc; the carry thus 
generated is used to trigger the input of the next input sample x(i) 1 01 . For each output 
sample y(i+d), the content of the accumulator (the remainder of accumulated phase divided 

30 by 2%) is provided as the delay 602. This same accumulating phase approach is used in a 
preferred embodiment of a decimator, disclosed following. 

FIG. 8 illustrates an example block diagram of an inverted Farrow filter 800 
that is optimized for decimation, or down-scaling, in accordance with this invention. Each 
filter segment 860-865 computes the following sum: 
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^Kn.Dx^.A.j (3) 

where the index / corresponds to the filter segment for the I th polynomial estimation term, 
b(n,/) are the coefficients of the estimation polynomial as discussed with respect to FIG. 3, 
and x and d are the input samples and corresponding delays relative to an output y(k), 

5 respectively. N is the number of taps in the filter and J is the number of inputs per output 
sample. The output of each filter segment 860-865 is summed to produce the output y(k) 23 1 , 
which corresponds to the generalized form of the decimation filter of FIG. 2, with the 
coefficients c(n,p) being replaced by the Farrow-filter based estimation polynomial of FIG. 3. 
As illustrated, in accordance with this aspect of the invention, each delay term dk-j is applied 

10 to the multipliers 830, and these multipliers are connected in series with each other. In this 
manner, the input to each filter segment 861-865 is the product of the input sample x and the 
delay raised to power /. That is, the x k .j. n * d k .j' term is provided directly as an input to each 
of the filter segments 860-865, thereby minimizing the computations within the dual 
summations of equation (3). In a preferred embodiment of this filter 800, each of the filter 

15 segments 860-865 is embodied using the structure of FIG. 4 (referenced US patent 
5,892,695), as illustrated in FIG. 9. 

FIG. 9 illustrates an example block diagram of a combination polyphase and 
Farrow filter 900 for down-scaling, or decimation, in accordance with this invention. In 
accordance with this aspect of the invention, the filter 900 includes a switch 910 that is used 

20 to select a decimating polyphase filter, or a decimating Farrow filter. To allow for this 

selection, filter segment 960 is configured to contain either the polyphase coefficients c(n,p), 
or the Farrow-filter estimation coefficients b(n,l), similar to the filter segment 760 discussed 
above with regard to FIGs. 7A-7B. If the desired down-scaling factor is supported by the 
stored polyphase filter coefficients c(n,p), then the filter 900 is placed in the polyphase filter 

25 mode, via the switch 91 0, to reduce the complexity of the required computations, similar to 
the combination polyphase and Farrow filter 700, discussed above. In this polyphase mode, 
only the filter segment 960 is used, and the output y(k) is taken directly from that segment 
960. If the desired down-scaling factor is not supported by the stored polyphase filter 
coefficients, all segments 960, 861-865 are used to generate the / polynomial terms based on 

30 the estimation parameters b(n,/), as discussed above, and the output y(k) is taken from the 
sum of all segments. Not illustrated, a multiplex switch, controlled by the state S of the 
switch 910 can be used to provide the appropriate output y(k) to a common output node, 
thereby making the mode used by the filter 900 "transparent" to subsequent stages. 
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The foregoing merely illustrates the principles of the invention. It will thus be 
appreciated that those skilled in the art will be able to devise various arrangements which, 
although not explicitly described or shown herein, embody the principles of the invention and 
are thus within its spirit and scope. For example, referenced US patent 5,892,695 illustrates 
5 an interpolation and decimation device that combines the functions of FIGs. 3 and 4, above, 
thereby requiring only one coefficient multiplier for each of the N taps of the filter. In like 
manner, the filter stages of FIGs. 7B and 9 can be combined (760 with 960, 661 with 861, ... 
665 with 865), such that only one coefficient multiplier is required for each of the N taps of 
each of the combined filter stages. FIG. 10 illustrates a filter stage 1000 that can be 
10 configured to correspond to either an interpolation filter stage or a decimation filter stage, via 
the switches 1010. 

FIG. 1 1 illustrates an example display system 1 100 having an image processor 
1 1 10 that includes a configurable filter 1 140. The filter 1 140 corresponds to one or more 
filters 700, 800, 900, or combination filters comprising filter stages 1000 to perform both 

1 5 interpolation and decimation. Typically, a display system 1 1 00 includes filters for effecting 
both horizontal and vertical scaling. The controller 1 120 determines the appropriate scaling 
in each dimension, sets the appropriate mode of the configurable filter 1 140 (interpolate or 
decimate, discrete phase or continuous phase, as required), and determines the appropriate 
coefficients that are provided by the memory 1 130, depending upon the scaling and the 

20 mode. 

The configurable filters and display system described herein may be embodied 
as hardware, software, or a combination of both. For example, the controller 1 120 is typically 
embodied as a software program that controls the flow of data through the image processor 
1110. The coefficient memory 1 130 may be a memory device that is used exclusively by the 

25 filter 1 140, or the coefficients may be embodied in the controller software and thereby 

located in a region of system memory. In like manner, all or part of the filters 700, 800, 900, 
1000 may be embodied in software, the example block diagrams corresponding to data flow 
diagrams of software routines. These and other system configuration and optimization 
features will be evident to one of ordinary skill in the art in view of this disclosure, and are 

30 included within the scope of the following claims. 
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CLAIMS: 



1 . An image display system (1 1 00) comprising: 

one or more configurable filters (700, 800, 900, 1000), and 

one or more controllable switches (710, 910, 1010) that are arranged to: 

configure the configurable filter (700, 800, 900, 1000) as a polyphase 
filter when the switches (710, 910, 1010) are controlled to a first state, and 

configure the configurable filter (700, 800, 900, 1000) as a Farrow 
filter when the switches (710, 910, 1010) are controlled to a second state. 

2. The image display system (1 100) of claim 1, wherein 

the image display system (1 100) is configured to provide a continuous 
interpolation for up-scaling an image (101) by configuring the configurable filter (700, 800, 
900, 1000) as the Farrow filter. 

3 . The image display system (1100) of claim 2, wherein 

the image display system (1 100) is further configured to provide a continuous 
decimation for downscaling the image (101, 201) by configuring the configurable filter (700, 
800, 900, 1000) as an inverted Farrow filter. 

4. The image display system (1 100) of claim 1, wherein 

the image display system (1 100) is configured to provide a continuous 
decimation for downscaling an image (201) by configuring the configurable filter (700, 800, 
900, 1 000) as an inverted Farrow filter. 

5 . The image display system (1100) of claim 1 , further including 

a display device (1 150) that is configured to render a display corresponding to 
an output (121, 231) of the one or more configurable filters (700, 800, 900, 1000) 
corresponding to a scaling of an image (101, 201) that is input to the configurable filter (700, 
800,900,1000). 
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6. The image display system (1 1 00) of claim 1 , wherein 

the one or more configurable filters (700, 800, 900, 1 000) include: 

a horizontal sample rate converter that is configured to scale an image 

(101 , 201) in a horizontal direction, and 

a vertical sample rate converter that is configured to scale an image 

(1 01 , 20 1 ) in a vertical direction. 

7. The image display system (1 1 00) of claim 1 , wherein 

the configurable filter (700, 800, 900, 1000) comprises a plurality of filter 
stages (660-665, 760, 860-865, 960, 1000), 

the plurality of filter stages (660-665, 760, 860-865, 960, 1 000) includes: 
a first filter stage (760, 960) that is configured to receive: 

first coefficients (c(n,p)) corresponding to coefficients of the 
polyphase filter, when the switches (710, 910, 1010) are controlled to the first state, and 

second coefficients (b(n,0)) corresponding to estimating 
coefficients for the Farrow filter, when the switches (710, 910, 1010) are controlled to the 
second state; and 

a remainder of filter stages (661-665, 861-865) that are each 

configured to receive: 

other coefficients (b(n,l)) corresponding to other estimating 
coefficients for the Farrow filter, when the switches (710, 910, 1010) are controlled to the 
second state. 

8. The image display system (1 100) of claim 1, further including: 
a memory (1 130) that is configured to contain: 

first coefficients (c(n,p)) corresponding to coefficients of the 

polyphase filter, and 

second coefficients (b(n,l)) corresponding to estimation parameters of 

the Farrow filter; and 

a controller (1 120) that is configured to facilitate the transfer of: 

the first coefficients (c(n,p)) from the memory to the configurable 
filter (700, 800, 900, 1000) when the switches (710, 910, 1010) are controlled to the first 
state, and 
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the second coefficients (b(n,l)) from the memory to the configurable 
filter (700, 800, 900, 1000) when the switches (710, 910, 1010) are controlled to the second 
state. 



5 9. A filter (800, 900) for producing an output sample (23 1 ) from a sequence of 

input samples (201) and a sequence of delays (802) corresponding to a temporal relationship 
between the output sample (23 1) and the input samples (201), the filter (800, 900) 
comprising: 

a plurality of filter stages (860-865, 960), 
10 a plurality of multipliers (830), and 

a plurality of adders (840), 
wherein, 

the plurality of multipliers (830) are arranged in series, wherein 

a first multiplier in the series of multipliers (830) receives each input 
15 of the sequence of input samples (20 1), and 

each multiplier of the plurality of multipliers (830) receives each 
delay of the sequence of delays (802); 

the plurality of filter stages (860-865, 960) are arranged in parallel, each stage 
having an input and an output, wherein 
20 a first stage (860, 960) of the plurality of filter stages (860-865, 960) 

receives as input each input of the sequence of input samples (201), and 

each subsequent stage (861-865) of the plurality of filter stages (860- 
865, 960) receives as input a corresponding output of each multiplier of the plurality of 
multipliers (830); and 
25 the plurality of adders (840) are arranged in series, wherein 

a first adder in the series of adders (840) receives the output of the 
first stage (860, 960) of the plurality of filter stages (860-865, 960) and the output of a second 
stage of the plurality of filter stages (860-865, 960), and 

each subsequent adder in the series of adders receives the 
30 corresponding output of each subsequent stage (861 -865) of the plurality of filter stages (860- 
865, 960). 



The filter (800, 900) of claim 9, wherein 
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each stage of the plurality of filter stages (860-865, 960) comprises a plurality 
of accumulators, 

wherein: 

each accumulator of the plurality of accumulators being configured to: 
5 multiply the input to the stage by a corresponding coefficient to form 

a product term, and 

accumulate an accumulated sum of the product term corresponding to 
each input sample of the sequence of input samples (201); and 

the output of each stage corresponds to a sum of the accumulated sum of each 

10 accumulator. 

11. The filter (800, 900) of claim 1 0, wherein 

the coefficient of each accumulator corresponds to an estimation coefficient 
(b(n,l)) of a Farrow filter. 

15 

12. The filter (900) of claim 1 0, further comprising 

a switch (910) that is configured to selectively isolate the first stage (960) of 
the plurality of filter stages (861-865, 960) from the subsequent stages (861-865) of the 
plurality of filter stages (861-865, 960), and 
20 wherein 

the plurality of accumulators of the first stage (960) are configured to receive 
as coefficient values: 

polyphase coefficients (c(n,p)) when the switch is in a first state that 
isolates the first stage (960) from the subsequent stages (861-865), and 
25 Farrow-filter coefficients (b(n,0)) when the switch is in a second state 

that couples the first stage (960) to the subsequent stages (861-865); and 

the plurality of accumulators of the subsequent stages (861-865) are 
configured to receive Farrow-filter coefficients (b(n,l)) as coefficient values. 

30 13. A method of filtering a first sequence of input samples ( 1 0 1 , 20 1 ) to provide a 

second sequence of (121, 231), comprising : 

determining a desired ratio of input samples (101 , 201 ) to output samples 

(121,231), 
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determining an available ratio of input samples (101, 201) to output samples 
(121, 231), based on an available set of polyphase coefficients (c(n,p)), and 

selectively filtering the first sequence of input samples (101, 201) to produce 
the second sequence of output samples (121, 231) using a select one of: 
a polyphase filter, and 
a Farrow-filter, 

in dependence upon the desired ratio and the available ratio. 



14. The method of claim 13, wherein 

1 0 selectively filtering the first sequence of input samples (1 01 , 201 ) is further 

dependent upon a control that is based on at least one of: a power utilization, a speed 
requirement, and a resource availability. 
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